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ABSTRACT 


A  communications  system  composed  of  n  transmitters  and  r  receivers  and 
which  is  subject  to  failure  is  modeled  as  a  semi-Markov  process  having  four 
states.   Transient  and  steady  state  results  are  analyzed  to  determine  the 
probability  that  the  system  is  in  any  given  state.   Two  examples  are  given 
to  illustrate  the  results  in  the  transient  as  well  as  in  the  steadv  state. 
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I.   INTRODUCTION 

A  communications  system  is  analyzed  which  has  n  transmitters  and  r  re- 
ceivers (r<n).   Each  transmitter  works  in  cycles  of  transmission  and  idle 
periods  of  time,  which  are  random.   Each  of  the  receivers  is  only  capable 
of  handling  one  message  at  the  time,  and   therefore,  messages  transmitted 
while  all  r  receivers  are  busy  are  then  lost. 

Transmitters  are  subject  to  failure  during  transmission  and  idle  periods, 
and  when  this  occurs,  it  takes  a  random  amount  of  time  to  be  repaired  and 
put  back  in  service. 

The  purpose  of  this  paper  is  to  describe  a  mathematical  model  for  the 
system  and  analyze  the  transient  and  steady  state  results  in  order  to  de- 
termine the  probability  of  a  given  message  being  lost. 

The  paper  is  written  in  four  parts.   In  Part  II  a  model  of  a  Semi-Markov 
process  is  formulated  and  its  variables  and  properties  defined.   Part  III 
contains  the  transient  results,  and  Part  IV  the  steady  state  results. 


II.   MODEL  FORMULATION 

Given  that  the  n  transmitters  composing  the  system  have  the  same  char- 
acteristics and  work  under  the  same  conditions,  the  probability  that  any 
of  them  is  transmitting  at  some  arbitrary  point  in  time  is  essentially  the 
same. 

Suppose  there  are  only  r  receivers,  each  of  which  can  receive  only  one 
message  at  the  time.   Then  if  L(t)  is  the  probability  that  a  message  trans- 
mitted at  t  is  lost, 
L(t)  =  P  [(r+1)  or  more  messages  are  being  transmitted  at  t] 

n 

/n\     k  k 

p(t)  Cl-p(t)]   , 

k  =  r+l 

where  p(t)  is  the  probability  an  individual  message  is  being  transmitted 
at  t. 

Our  problem  is  to  determine  p(t).   Consider  a  system  where  a  transmitter 
transmits  for  some  fixed  time  ex  ,  and  is  idle  (not  transmitting)  for  some 
fixed  time  6  .   Also  assume  the  transmitter  never  fails  and  that  we  measure 
time  zero  from  the  start  of  a  new  transmission  time.   Then, 

p(t)  =  1   n(a+B)£  t<.    n(a+8)  +a ,  n=  0,1,2,... 

=    0       otherwise   . 
This   is   illustrated   in  figure   1. 
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Figure  1.   A  simple  example  for  p(t). 

In  our  model  we  consider  the  transmission  and  idle  times  as  random 
variables.   Also  we  include  the  possibility  of  transmitter  failure  both 
while  transmitting  and  while  idling.   We  assume  that  if  it  fails,  it  takes 
a  random  repair  time  to  fix,  at  which  point  it  starts  over  a  new  transmit 
or  idle  time,  depending  on  its  state  at  time  of  failure.   Thus  the  system 
can  be  in  one  of  four  states: 


State 


Description 


0 
1 
2 


Transmitting 

Idle  and  up 

On  repair  (failure  occurred 
during  tranmission) 

On  repair  (failure  occurred 
during  idle  period) 


Let  T^  be  the  length  of  the  i   transmission,  { T .  }  i.i.d.  random  vari- 
ables with  distribution  function  (d.f.)  T(t).   Thus  T(t)  -  P(T.  ^  t), 
i  =  1,2...  .   Also  let  I.  be  the  length  of  the  ith  idle  time,  { Ii  }  i.i.d. 
random  variables  with  d.f.  I(t).   If  the  system  is  operating  (either 


transmitting  or  idle)  we  assume  an  exponential  time  to  failure  with  rate  X 
(mean  time  to  failure  is  1/^.).   Once  failed,  the  time  to  repair  is  also 
assumed  to  be  exponential  at  rate  u,  (mean  repair  time  1/ a, )  independent  of 
whether  the  transmitter  was  idle  or  transmitting. 

Thus  the  transmitter  follows  a  stochastic  process  which  makes  transi- 
tions according  to  a  Markov  Chain  when  viewed  at  points  at  which  it  changes 
state.   It  is  crucial  that  times  to  failure  be  exponential  for  the  Markov 
property  to  hold.   For  example,  if  the  transmitter  makes  a  transition  from 
idle  to  transmit  (state  1  to  state  0) ,  then  if  the  distribution  of  time  to 
the  next  transition  is  to  be  independent  of  all  previous  history  of  the 
process,  the  knowledge  of  when  the  system  last  failed  and  was  repaired  must 
be  irrelevant.   This  can  only  be  true  with  exponential  times  to  failure. 
It  is  not  important  in  the  model  that  the  repair  times  be  exponential. 

The  amount  of  time  spent  in  each  state  before  a  transition  occurs  is 
random.   Defining  Z(t)  =lstate  of  the  process  at  time  t  J ;  then  the  stochas- 
tic process  jz(t),  t  >  0J  is  a  Serai-Markov  Process,  and  p(t)  =  pfz(t)  =  OJ  . 


We  now  define 


QtjW 


'a  m 


=   P 


process  next  makes  a  transition 
into  state  j  and  this  occurs 
in  a  time  £  t 


m   P  [  state  at  time  t  is  j 
=  P  [z(t)  =  j  |  Z(0)  -  i] 


F±j(t)  =  P 


a  transition  will  occur 
in  an  amount  of  time  •£  t 


process  has 
just  entered 
i 

process  started 
in  state  i  at 
time  0 


process  has  just 
entered  i  and 
will  next  enter  ; 


(2) 


(3) 


(4) 


H..(t)  =  P   next  transition  occurs 

in  an  amount  of  time  £  t 


Plj=Qij(-)  =  P 


next  transition  will 
be  into  state  j 


process  has 
just  entered 
i 

process  just 
entered  i 


(5) 
(6) 


Since  Q- . (t)  is  the  joint  probability  that  the  next  transition  is  from  i  to 
j  and  in  time  less  than  t,  we  have 


j      -p<j 


luUen    "Pij  >    O  ;  (7) 


and   thus 


H;M«2>yFyw  -£©*»■<*> 


J=o 


(?) 


It  can  be  shown  (Ross  [l])  that 


3    X 


HjW  --  Sit  [l  -  HiW]  +  ]T  /%  &-»)  ifluW  , 


0) 


where  o  £j  is  the  Kroneker  delta. 


If  we  let  H^t)  =  1  -  H.(t)  and  qik*Pk- (t)  indicate   the  convolution 
in  (9) ,  we  obtain 


fcc  r  o 


This  expression  can  also  be  written  in  matrix  form  as 

where  /-/>(t)is   a  diagonal  matrix  of  %(t)  and  O  *  j^C't)    is  the  matrix 


convolution  with  ij    element 


L-       st 


We   can  also   define 


/Li*    |    t    cltfjM  (jZ) 


as  the  expected  amount  of  time  spent  in  state  i  during  each  visit;  and 


0 

as  the  expected  amount  of  time  spent  in  i  during  each  visit,  given  that 
the  next  state  entered  is  j . 
It  follows  that 


>*■£*%?</ . 


(14) 


TO 


III.   TRANSIENT  RESULTS 

We  first  examine  the  transient  results.   In  order  to  do  so,  we  assume 
that  the  transmission  and  idle  times  have  general  distributions,  while  fail- 
ure and  repair  times  have  exponential  distributions.   That  is 
T  =  transmission  time   />»/   T(t) 
I  =  idle  time  ^J      I(t) 


X  s  time  to  failure    /^   1-e' 


%t 


R  =  repair  time 


l-e-/* 


and  find  that 


Pqj  =  1   next  transition  will  be 


We  first  compute  J=     j  P .  .] 

1 


into  state  1 


=  PI  failure  time >  transmission  time! 
=  P   (X>T)  «   I  e~^*  dT(x)  =  t(X). 


process  j 
entered  s 


ust 
tate  0 


Also 


P10=  P 


next  transition  will  be 
into  state  0 


pr 

en 


ocess   just 
tered   state  1 j 


=  P  [failure   time>  transmission   time! 

=  P      (X>I)    =    /     e^   dl(x)    =    i(^.). 

where  t(^.)  and  ±(X)    are  the  Laplace-Stieljes  transforms  of  the  trans- 
mission and  idle  times  distributions  evaluated  at  A.   ,  the  failure  rate. 


Now  P 


"[p«]lso 


f  the  following  form 
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p  -- 


0 

tU) 

l-tCO 

0 

I  a) 

0 

o 

1-tW 

l 

0 

0 

0 

0 

1 

0 

0 

We  need  to  find  /""(t)  =  j  F^Ct)   as  defined  in  (4) 


Now, 


F..(t)  -  p[r<t  |t<x]  - 


p[T<t ,  T<  x  ] 
p[T<x] 


In  order  to  determine  the  joint  probability  distribution  of  X  and  T 
we  "condition"  in  the  value  of  X. 


"p[T<-t]       if   **'* 


p[r<t,T<x|x»*]  = 


\v[T< 


]  4 


14-       *<l  , 


and   then 


a    cnen  +  f  a 

P(T<  t ,  T<  x] .  -     fr^  X  e-A*«t*  *  /  TW  4  e-*rrf* 


so 


fca"AVft) 


rol  no  -   Jo   „, 


:*£T&) 


too 

Following  the  same  procedure  we  find 


11 


FT*  (ti  * 


i  -  tc;o 
TiX) 


1-  tW) 

We  will  now  determine  £   (t)  =  f  Q±j (t)    by  using  the  relation  de- 


fined  in    (7);    i.e. 


H 

*w"     py 

This   gives  us 

Jo 

t^»)  -    l.TWtf*-,^^' 

«,.t«  ■ 

rter**d_U&    , 

«.,  Lt)  -   flf.W  =  fl*  C*>  -  Q«  C-t)  •  Qti  t*>  =  £3o  (t)  " 

By  means  of  the  relation  (8)  we  find  that 


12 


H„  CO   -  TW  e"w'  , 
M,  0*)    «  I  M  e'xc  . 

H>M    -■£«*>■ 


We  now  have  the  necessary  elements  to  compute  the  relationship  stated 
in  (11);  that  is, 


i°w  =  //, «)  *  3  •p^; 


to 


determine  JT  (t) . 


Taking  Laplace  transforms  and  rewriting  (11)  we  get 

pes)  -   g&  +  $C*>P<s> 


which  can  also  be  written 


-i  - 


Pes*  -[i-£<«>]  &<*) 


Now  we  have  that 


(S)* 


t(l«*) 


tt^> 


;w 


rW 


[i  -  ±aw>] 


fr[i-*H 
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where,  for  instance,  q„0(s)  is  determined  by 

J0  Jo  'o 

J"ex'[e'xt-rLt)Q-xt']cit 

-^.    XT(Us), 

where   T(/t+s)  is  the  Laplace  transform  of  the  distribution  of  transmission 
time,  and  we  know  that 


so  then 


In  our  problem  we  are  only  interested  in  /"\-.n(t);  i.e.,  the  probability 
that  a  transmitter  isin a  transmission  period  at  time  t.   Then  we  only  need 
to  determine  ^qq(s).   But  I   §q(s)    is  the  (0,0)  element  of   [l-q(s)J  ^(s) 
which  requires  only  the  (0,0)  element  of   ll-q(s)J   .   Because  of  the  special 
structure  of  q(s)  algebraic  inversion  to  obtain  this  one  element  was  possi- 
ble.  After  much  algebra  the  result  is 


[j-Aii-H^K1-  tb[i-rMf<s>} 


-  l(X**)ttt+*) 
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Two  examples  are  given  to  illustrate  the  transient  results. 

Example  1 

Let  transmission  time  be  exponential  with  mean  «  and  idle  time  also  ex- 
ponential with  mean  p .   Then 

£  (S)  - L —  .  .  . 


fS1 


[ztx+ii)+  'A*'/?]*1  +  $3} 


This  can  be  written  as 


5  ,,\  -  <s^)Cs*OC»^  (i5) 

where  a,  b  and  c  must  satisfy  the  relations 

abc  =  /I/A     > 

c(a+b)+ab   =  J£   +    2uL    4    XfJ^    , 

a+b+c  =    ZfJL  4-     l/a    4-     X  • 

Also  d,    f   and   g  must   satisfy 

d(f+g)+fg  =     (Z+U)\    (3/L4i)(±*    A)    , 

d+f+g  =  2(H+/i)  +  '/*+  '/fi   • 

Then  the  inverse  of  the  Laplace  transform  in  (15)  will  be 

P..6t)  =  A  +©0-f)e-**+c(i-|-)e^+>>Ci-f-)e-3t 

15 


where 

ot  fee 


A- 
5  = 


If  we  let 


then, 


_.D33t  «.03<)t         „  -.554* 

?2oC0*  .0784- .ooie         +.oi3e        +  .<?0*e 


Figure  2  illustrates  i  nn(t)  for  different  values  of  t.  It  can  be  ob- 
served that  for  the  given  parameters  values,  the  system  reaches  the  steady 
state  very  fast. 

Besides  the  method  just  described  to  take  the  inverse  of  £qq(s), 
numerical  inversion  (LINV  IBM-360)  was  used  and  yielded  the  same  results 
for  r       (t)   using  different  values  of  t. 

Table  I  shows  L(t),  the  probability  that  a  message  transmitted  at  time  t 
is  lost,  for  different  values  of  t  and  for  n  =  30  and  r  =  3. 
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-f2-Ct> 


Sstc. 


tosec. 


/5  *«c. 


Figure  2.  The  probability  that  a  transmitter  is 
in  a  transmission  period  plotted  as  a 
function    of    t. 


L(t) 


0  sec. 

1.0 

• 

2      " 

0.99 

3      " 

0.99 

4      " 

0.97 

5      " 

0.85 

6      " 

0.68 

7      " 

0.49 

8      " 

0.35 

9     " 

0.30 

JO     " 

0.28 

Table   I. 

Probabili 

tv   that 

at    time    t    is   lost. 
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Example  2 

Let  of  be  the  transmission  time  and  p    the  idle  period  length,  both 
assumed  constant,  and  failure  and  repair  times  have  exponential  distribu- 
tions with  parameters  X   and  Li,   respectively.  Then 


Using  numerical  inversion  did  not  give  accurate  results  because  of  the 
existence  of  sharp  peaks  in  j^nn(t)  due  to  the  constant   transmission  and 
idle  times  assumed.   Exact  inversion  in  this  case  was  not  found  to  be 
possible. 
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IV .   STEADY  STATE  RESULTS 

We  now  examine  the  output  of  the  model  after  a  long  period  of  time; 

that  is,  in  the  steady  state. 

If  we  denote  by  J   the  initial  state  of  the  process,  and  for  n>   1  let 
o 

Jn  denote  the  state  of  the  process  immediately  after  the  n   transition  has 
occurred,  the  process  |  J  ,  n  =  0,1,2,...!   is  an  embedded  Markov  Chain  with 
transition  probabilities  P,-  A    -   Q--(°°)>      Furthermore,  if  the  embedded  Markov 
Chain  is  aperiodic  and  irreducible,  defining 


it  can  be  shown  (Ross  [l]  )  that 


J*  ,    //*    p[  Z  M   «  j  }  t(o)  *  i] 


*-#*-•  (10 


where  f\. ,  j  =  0,1,2,3  are  the  limiting  probabilities  for  the  embedded 

Markov  Chain.   That  is,  if  7T=  (  fro  ^1^2  ^V '  then  the  ^V s  are  the  solu" 
tions  for    7Tr  IT-  P     ,  y  3       IT;    *    1      , 

The  same  examples  used  to  illustrate  the  transient  results  will  be  used 
here. 

On  example  1  transmission  and  idle  times  have  both  exponential  distri- 
butions with  parameters  '/^  and  lA    respectively.   The  matrix  F^is  now  given 
by 
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r* 


i 

o 


i««4 


0 

1 


1- 


l+<a 


o 

0 


1- 


1+^A 


o 
o 


J 


ever 


This  /^  matrix  is  of  a  chain  with  period  2  so  is  not  aperiodic.   How- 

3 

the  equations  i^Tl'i  /  if*   =  1  can  still  be  solved  in  which  case 

•  -41     -I 


J'* 


the  ft . ' s  are  interpreted  to  be  the  probability  of  being  in  a  given  state 
at  an  arbitrary  time  point.   If  one  knew  that  the  time  point  were  an  odd 
or  even  number  of  periods  after  the  process  started  then  the  probability 
of  being  in  a  given  state  would  not  be  given  by  the  fl.  's.   However,  such 
a  situation  is  not  of  interest  to  us  in  this  paper  and  the  ft. 's  are  in  fact 
the  numbers  which  we  want. 

Using  this  matrix  of  transition  probabilities  we  arrive  at 


X> 

If.    .-**-. 


IK 


A 


where  ]>  «  z[l  +  (*  *  f3)  fl,]  . 
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Recalling  that  we  defined  the  expected  amount  of  time  spent  in  state  i 

during  each  visit,  given  that  the  next  state  entered  is  j  as 

<x> 


y,ij  •  f  t  AFijM 


have 

"&/  = 

1 

1/ct    *X 

\o^ 

I 

y*  +  x 

fc.« 

i 

t/r% 

<»• 

i 

l/A  +  X 

l*  *  t*  *  V/l 


The   expected   amount   of   time   spent   in  each   of    the   states   in  each 
visit,        /Xl    --    )        PijKi!    >  is 

A  -/*»  -  '/u.  • 

It  is  possible  now  to  compute  P.,  j  =  0,1,2,3  by  using  the  results  just 
derived  and  the  relation  stated  in  (16). 

On  example  2  we  let  oL    and  A  be  the  transmission  and  idle  times  re- 
spectively, assumed  constant.   We  also  let  failure  and  repair  times  have 
exponential  distributions  with  parameters  X    an^  UL   respectively.   The  ma- 
trix JP  =  |P.  1  will  then  be 

21 


7^  = 


o 


,-fX 


e-*x        l-e-*x        o 


l-tfP 


Using  the  same  procedure  as  in  example  1,  we  can  find  the  necessary  elements 
to  solve  for  the  P. '  s. 

Table  II  shows  the  values  of  the  P^'s,  j  =  0,1,2,3  computed  for  exam- 
ples 1  and  2  for  o(  =  2.0,   |3  =  20.0,  1/%  =  180.0  and  1/V  =  30.0  seconds. 


State  j 

Probabil: 
Example  1 . 

Lties  P- 

Example  2. 

0 

0.0779222 

0.1109148 

1 

0.7792229 

0.8888418 

2 

0.0129867 

0.0000211 

3 

0.1298679 

0.0002221 

Table  II. 

Steady 

state  probabilities 

for  example 

1  and  2. 

We  can  now  compute  !(oo),  the  steady  state  probability  that  a  message 
is  lost,  by  means  of  the  relation  stated  in  Part  II. 

Table  III  shows  the  values  of  L(oo)  for  different  values  of  n  and  r 
for  examples  1  and  2. 
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20 
30 
40 
50 


Example 

1. 

Example 

2. 

r        2 

3 

4 

5 

2 

3 

4 

5 

.21 

.07 

.02 

.004 

.38 

.13 

.04 

.02 

.43 

.21 

.09 

.03 

.66 

.42 

.23 

.10 

.63 

.39 

.21 

.09 

.83 

.65 

.45 

.27 

.77 

.57 

.37 

.20 

.92 

.81 

.66 

.47 

Table  III.   Steady  state  probability  that  a  message  is  lost 
computed  for  examples  1  and  2. 


The  case  n  =  30  is  shown  plotted  in  figure  3  for  different  values  of 
the  number  of  receivers.   For  both  examples  we  see  that  the  loss  probability 
decreases  rapidly  with  an  increase  in  the  number  of  receivers,  and  for  r  =  5 
the  loss  probabilities  decrease  to  .03  and  .10  for  examples  1  and  2  respec- 
tively. 


L(r) 

1.0  ■ 

Ex.  l\ 

\  Ex.2 

• 

.5 

\ 

1 1 

n=30 
1 , 

Figure  3.  Probability  of  a  lost  message  as  a 
function  of  the  number  of  receivers 
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